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ABSTRACT 

This  paper  presents  a  detailed  description  of 
the  nature  of  ASTIA's  report  literature  control  problem 
and  the  evaluation  of  a  mechanized  system  for  storage  and 
retrieval  of  document  references  pertaining  to  science, 
technology,  and  medicine.  The  application  of  the  thesaurus 
concept  for  control  of  an  indexing  vocabulary  is  related 
and  the  revision  of  the  First  Edition  of  the  Thesaurus 
of  AST I A  Descriptors  is  explained.  Problems  arising 
from  efforts  to  evaluate  terminology  and  Indicate  rela¬ 
tionships  among  selected  descriptors  are  discussed  in 
terms  of  the  broad  principles  derived.  Emphasis  is 
placed  on  the  importance  of  the  human  element  in  a  mecha¬ 
nized  information  retrieval  system.  The  advantages  of 
maintaining  a  degree  of  simplicity  that  permits  efficient 
utilization  of  the  system  by  all  types  of  users  are  set 
forth.  The  desirability  of  compiling  various  aids  for 
the  Indexer  and  bibliographer  such  as  displays  of  groups 
of  subject-related  descriptors,  frequencies  of  descriptor 
usage  in  indexing  and  searching,  descriptor  assignment 
relationships,  scope  notes  or  definitions  of  ambiguous 
terms,  and  manual  files  of  lightly  posted  descriptors  is 
suggested.  The  utility  of  the  descriptor  vocabulary  as 
a  means  of  indexing  accessioned  documents,  formulating 
search  strategies  and  compiling  subject  indexes  for 
abstract  bulletins  and  other  publications  is  discussed 
on  the  basis  of  operating  experience.  The  importance  of 
cooperative  efforts  among  the  major  information  centers 
with  respect  to  vocabulary  development,  abstract  stand¬ 
ardization,  and  document  indexing  is  considered. 
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INTRODUCTION 

One  of  the  most  crucial  problem  areas  In  the 
process  of  research,  development,  testing,  and  evaluation 
Is  science  Information  communication.  It  Is  quite  obvious 
that  before  the  results  of  research  can  be  exploited 
effectively  they  must  first  be  put  under  bibliographic 
control  and  made  available  to  everyone  who  can  use  them. 

As  the  research  and  development  spectrum  expands,  with 
Increasing  allocations  of  resources  Involved,  the  time 
gap  between  scientific  and  technological  discovery  and 
reporting  and  application  tends  to  widen. 

In  the  scientific  and  Industrial  community. 
Journal  publications,  meetings,  and  symposia  have  been 
the  chief  means  of  keeping  abreast  of  the  constantly 
accumulating  mass  of  new  findings  elucidated  by  scientific 
research.  In  the  Department  of  Defense  (DOD),  the  largest 
research  sponsor,  responsibility  for  collecting,  analyzing, 
and  disseminating  the  results  of  research  and  development 
Is  centered  primarily  In  the  Armed  Services  Technical 
Information  Agency  (ASTIA). 

In  the  years  since  Its  Inception,  ASTIA  has 
accumulated  a  vast  and  comprehensive  collection  of  more 
than  700,000  technical  reports  In  virtually  all  fields 
of  science,  technology,  and  medicine.  ASTIA  presently 
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receives,  abstracts,  and  Indexes  30,000  reports  each 
year;  these  are  announced  in  a  semi-monthly  abstract 
Journal,  the  Technical  Abstract  Bulletin  (TAB),  In 
the  next  two  years  the  total  accessions  are  expected  to 
reach  300,000  reports  annually,  as  a  result  of  ASTTA's 
new  acquisition  policy. 

ASTIA  makes  available  to  DOD  contractors  and 
military  organizations  full  sized  copies  of  reports  and, 
upon  request,  supplies  bibliographies  of  Its  holdings 
on  any  given  subject.  At  present,  requests  for  more 
than  3500  reports  and  25  literature  searches  are  received 
per  day  from  among  ^,000  users.  These  figures  are  expected 
to  rise  in  proportion  to  the  increase  in  accessions. 

These  Increases  In  workloads  over  the  past 
five  years  lead,  in  1959^  to  the  adoption  of  automatic  data 
processing  techniques  for  processing  report  requests  and 
performing  literature  searches.  As  part  of  this  con¬ 
version  to  machine  methods,  the  subject  heading  method 
of  subject  analysis,  used  at  ASTIA  since  19^7,  was  rede¬ 
signed  into  a  concept  coordination  or  descriptor  system. 

In  the  evolutionary  steps  traversed  by  the  docu¬ 
ment  processing  center  of  ASTIA  from  a  highly  developed 
manual  system  of  subject  heading  control  to  a  completely 
mechanized  coordinate  system  of  classification,  the  most 
significant  contribution  was  the  development  of  an  authori¬ 
tative  indexing  vocabulary  from  the  ASTIA  Subject  Heading 


-3- 


List.  The  conversion  from  subject  headings  to  descrip¬ 
tors  and  the  relndexlng  of  the  200,000  most  recent  were 
achieved  as  a  result  of  ASTIA's  Project  MARS.  In  this 
vocabulary  development,  the  major  subject  headings 
were  divorced  from  their  subdivisions  and.  In  one  move, 
the  list  was  reduced  from  70,000  combinations  to  about 
8300  main  headings.  The  850  subdivisions  were  reduced 
to  about  600  resulting  In  a  vocabulary  of  some  9000 
terms. 

This  draft  vocabulary  was  then  edited  and  puri¬ 
fied  by  eliminating  synonomous  terms  and  establishing 
appropriate  cross  references.  Also,  many  of  the  Infre¬ 
quently  used  terms  were  coalesced  and  Included  In  closely 
related  terms.  These  actions  further  reduced  the  number 
of  descriptors  to  less  than  7000.  Finally,  the  descrip¬ 
tors  were  organized  into  292  groups  of  logically  related 
terms  and  19  subject  discipline  fields  designed  according 
to  a  quasi  helrarchlcal  classification  system.  A  volume 
containing  the  descriptors,  their  cross  references,  and  ‘ 
the  descriptor  groups  and  fields  was  published  In  May 
i960  as  the  Thesaurus  of  ASTIA  Descriptors. 

Revision  of  the  ASTIA  Thesaurus 

Despite  the  numerous  shortcomings  of  the 
Thesaurus  vocabulary,  not  the  thesaurus  concept,  the 
conversion  to  a  descriptor  coordination  approach  repre- 


sented  a  milestone  in  ASTIA's  history.  In  addition  to 
the  many  advantages  resulting  from  the  establishment 
of  the  coordinate  retrieval  concept,  the  system  also  demon¬ 
strated  unlimited  potentialities  with  respect  to  the  pro¬ 
duction  of  bibliographic  reference  and  search  tools.  At 
the  time  of  publication,  the  Thesaurus  was  known  to  be 
incomplete  and  known  to  contain  many,  but  not  insur¬ 
mountable,  deficiencies  that  would  certainly  be  eliminated 
or  reduced  in  subsequent  editions.  With  this  realization 
ASTIA  soon  initiated  a  research  project  which  had  as 
its  objective  the  refinement  and  revision  of  the  Thesaur^ 
of  ASTIA  Descriptors,  First  Editioji. 

Since  the  thesaurus  concept  as  developed  by 
ASTIA  had  generated  such  keen  interest  among  specialists 
in  the  field  of  information  science  and  because  it  had 
gained  widespread  acceptance  throughout  the  DOD  scienti¬ 
fic  community  as  well  as  the  industrial  community  and 
the  general  public,  ASTIA  enlisted  the  assistance  and 
advice  of  subject  matter  specialists  and  documentation 
experts  from  government,  industry,  and  education  for 
this  revision  effort.  By  requesting  outside  cooper¬ 
ation  and  active  participation,  it  was  felt  that  vocabu¬ 
lary  compatibility  among  government  and  non-government 
operated  activities  engaged  in  Information  retrieval 
could  be  achieved  more  easily  and  that  standardization 


-5- 


of  related  bibliographic  aids  could  be  ensured.  The 
first  product  of  the  cooperative  effort  was  the  formu¬ 
lation  of  a  statement  of  general  guidelines  to  be  fol¬ 
lowed  and  objectives  to  be  attained  in  the  revision 
process  (Ref  l).  Under  the  Joint  auspices  of  ASTIA 
and  the  Engineers  Joint  Council,  a  panel  of  documenta- 
lists  and  subject  specialists  was  organized  to  undertake 
the  actual  task  of  revision  (Ref  2), 

Compliance  with  the  guidelines  entailed  an 
evaluation  of  each  entry  in  the  First  Edition  in  regard 
to  its  utility  for  indexing  at  ASTIA  as  determined  by 
the  frequency  of  its  use  in  indexing  accessioned  docu¬ 
ments  and  its  acceptability  and  significance  as  a  scien¬ 
tific  term.  A  determination  was  made  of  the  relation¬ 
ships,  both  generic  and  logical,  of  each  term  to  other 
terms  in  the  vocabulary.  Finally,  explicit  statements 
were  provided  regarding  the  use  of  ambiguous  terms  to 
which  was  attached  a  special  meaning  that  was  not  readily 
dlscernable. 

The  three  criteria,  utility,  frequency  of  use, 
and  acceptability,  are  obviously  Interrelated  and  should 
properly  be  considered  facets  of  evaluation  rather  than 
distinct  qualities,  but  are  separated  for  purposes  of 
discussion.  Examples  are  given  to  Illustrate  the  types 
of  decisions  that  were  made. 
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utility  for  retrieval  is,  at  best,  a  nebulous 
quality  and  was  more  often  than  not  determined  subjec¬ 
tively  by  the  Judgnent  of  experience  bibliographers 
and  Indexers.  For  example,  the  term  "Physical  properties" 
occurs  frequently  in  the  literature  and,  as  a  descriptor, 
had  been  used  often  by  ASTIA  indexers.  However,  despite 
any  connotation  by  the  term  when  it  appeared  in  context 
with  specific  chemical  compounds,  materials,  etc.,  it 
had  proven  to  be  almost  meaningless  when  used  to  phrase 
queries  because  of  the  wide  range  of  possible  properties 
Involved  and  was  abandoned,  with  provision  for  recata¬ 
loging  on  the  basis  of  more  specific  terms. 

The  frequency  of  posting  of  the  descriptors 
in  the  indexing  of  some  230,000  documents  gave  quanti¬ 
tative  evidence  of  their  utility,  although  these  statis¬ 
tics  alone  did  not  prove  the  value  of  the  various  terms. 
Descriptors  posted  ten  or  fewer  times  were  suspected 
to  be  of  little  use  and  most  of  these  were  either  included 
under  more  general  concepts  or  made  the  object  of  a 
coordination  of  two  or  more  other  descriptors.  For 
example,  "Apricots"  was  properly  included  totally  by 
the  more  general  teirni  "Fruits",  whereas  "Platinum  elec¬ 
trodes"  now  appears  as  an  Instruction  to  use  "Platinum" 
and  "Electrodes",  a  logical  coordination  of  two  descrip¬ 
tors  already  in  the  vocabulary. 
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Not  all  lightly  posted  terms  were  disposed 
of,  however.  The  descriptor  "Earthquake-resistant 
structures"  was  retained  although  it  had  been  used 
only  seven  times  in  Indexing  the  entire  collection 
because  there  were  no  other  descriptors  that  could 
adequately  convey  this  concept.  On  the  other  hand, 
many  descriptors  in  the  vocabulary  had  been  posted 
frequently  but  did  not  represent  really  significant 
concepts.  One  example  is  "Control  valves",  a  term 
that  had  been  used  126  times  in  indexing  but  upon 
examination  was  found  to  be  merely  an  unfortunate 
choice  of  words  that  had  been  coined  several  years 
earlier  in  an  effort  to  inject  some  specificity  into 
the  subject  heading  list.  Several  descriptors  were 
clearly  enough  defined  and  consistently  used  within 
ASTIA  but  were  not  entirely  acceptable  or  understood 
elsewhere.  One  such  instance  is  "Electrostatic  capaci¬ 
tance",  a  term  that  had  traditionally  been  used  in  lieu 
of  the  more  commonly  encountered  "Capacitance".  This 
situation  was  reversed  to  help  make  the  vocabulary 
more  palatable  to  those  outside  ASTIA. 

A  major  change  in  the  format  of  the  revised 
Thesaurus  is  the  development  and  display  of  generic 
relationships.  The  intent  in  showing  these  relation¬ 
ships  is  to  further  delineate  the  concept  represented 
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by  the  descriptor  and  to  provide  Immediate  access  to 
terms  that  are  considered  to  be  more  general  or  more 
specific.  The  generic  relationships  are  Indicated  by 
"Generic  to"  and  "Specific  to"  references  and  are  pro¬ 
vided  only  where  appropriate  terms  existed  In  the  vocabu¬ 
lary,  having  been  subjected  to  the  evaluation  of  utility 
previously  discussed.  In  general,  no  effort  was  made 
to  manufacture  descriptors  or  to  introduce  terms  not 
previously  used  by  ASTIA  merely  for  the  sake  of  having 
symmetrical  cross  references.  At  a  given  descriptor 
entry,  more  general  descriptors  are  indicated  by  a 
"Specific  to"  reference  and  more  specific  descriptors 
are  indicated  by  a  "Generic  to"  reference.  For  instance, 
"Halogens"  was  listed  as  "Generic  to"  references  "Bromine 
’thlorine",  etc,,  and  each  specific  halogen  was  the  des¬ 
criptor  "Halogens"  as  a  "Specific  to"  reference. 

The  procedure  used  in  the  First  Edition  of 
displaying  descriptors  considered  to  be  logically  related 
to  a  given  descriptor  as  "Also  see"  references  was  re¬ 
tained,  This  device  is  valuable  in  the  use  of  the  The¬ 
saurus,  but  the  subjective  Judgments  involved  in  deter¬ 
mining  useful  logical  relationships  among  descriptors 
present  many  difficulties  and  make  virtually  impossible 
the  development  of  complete  references.  All  logical 
relationships  cannot  be  foreseen  at  the  time  a  descrip¬ 
tor  is  evaluated,  so  only  the  more  obvious  cross  refer- 
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ences  were  made.  As  a  result  some  of  the  references 
may  prove  worthless,  whereas  there  will  be  a  need  for 
adding  references  as  experience  dictates. 

The  most  significant  change  and  the  one  that 
will  probably  be  of  most  benefit  to  users  of  the 
Thesaurus  is  the  provision  of  scope  notes  to  delineate 
the  meaning  of  ambiguous  descriptors  and  to  distinguish 
among  descriptors  having  partially  overlapping  mean¬ 
ings.  Most  scope  notes  take  the  form  of  explanatory 
phrases,  with  examples  where  necessary  to  convey  a 
meaning.  These  notes  are  Intended  to  be  read  as  part 
of  the  cross  references  and  reflect  the  use  of  the 
term  by  ASTIA.  The  term,  cryogenics,  for  example,  is 
often  used  and  generally  understood,  but  it  has  come  to 
have  different  meanings  in  the  fields  of  rocket  propel¬ 
lants  and  solid  state  physics.  Equipment  for  handling 
liquefied  gases  might  be  completely  unsuitable  for 
studying  superconductivity,  whereas  writers  in  both 
areas  often  describe  their  studies  as  "cryogenics". 

If  such  a  term  is  available  in  an  Indexing  vocabulary 
the  natural  inclination  of  the  indexers  will  be  to  index 
documents  in  both  fields  with  the  same  term,  creating 
an  unreliable  retrieval  situation.  Therefore,  the 
descriptor  was  given  a  scope  note  imposing  an  cL'bltrary 
parameter  on  the  temperature  ranges  as  dictated  by  ASTIA 
usage. 
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No  effort  was  made  to  provide  dictionary 
definitions  for  terms  that  are  unambiguously  used  in 
the  literature.  Terms  with  more  than  one  popular 
meaning  or  with  meanings  that  differ  appreciably  in 
various  scientific  disciplines  were  assigned  the  con¬ 
notation  Imposed  by  ASTIA,  or  if  used  in  differing  con¬ 
notations,  were  made  separate  descriptors  by  means  of 
parenthetical  expressions. 

Terms  that  represent  concepts  within  the 
scope  of  a  given  descriptor  but  more  specific  than 
necessary  for  indexing  the  ASTIA  col lection  are  entered 
as  "Includes'*  references  at  the  descriptor,  as  are 
popular  synonyms.  Such  terms  also  appear  in  their 
alphabetic  sequence  with  the  Instruction  "Use"  the 
appropriate  descriptor.  Hence,  the  descriptor  "Dis¬ 
sociation"  has  as  an  "includes"  reference  "Thermal  ; 
dissociation".  The  latter,  in  its  alphabetical  sequence 
bears  the  Instruction  "Use  Dissociation",  Terms  that 
represent  concepts  that  are  not  expressed  directly  by 
descriptors  but  are  indexed  by  a  combination  of  des¬ 
criptors  also  appear  in  their  alphabetic  order  with 
an  instruction  to  "Use"  the  appropriate  combination. 

For  example,  "Anticorrosive  points"  appears  as  an 
instruction  to  use  "Corrosion  inhibition"  and  "Points". 
These  references  permit  access  to  the  Indexing  vocabu¬ 
lary  on  the  basis  of  a  recognized  terminology  not  used 
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for  indexing,  (Representative  Thesaurus  entries 
are  shown  in  Figure  1.) 

Indexing  at  ASTIA  is  performed  by  professional 
personnel  who  consistently  handle  reports  in  fairly 
narrow  subject  fields.  The  same  individuals  analyze 
queries  in  their  fields  and  formulate  search  patterns 
to  locate  the  desired  information  in  the  collection. 

The  general  approach  is  to  coordinate  two  groups  of 
descriptors,  the  result  being  references  to  all  docu¬ 
ments  in  the  collection  that  have  in  common  any  des¬ 
criptor  pair  from  the  two  groups.  Several  variations 
in  search  strategy  are  possible.  All  holdings  posted 
with  a  given  descriptor  or  descriptors  can  be  retrieved 
without  coordination;  three  or  four  grbUps,  or  levels, 
of  coordination  can  be  used;  or  document  references 
posted  with  chosen  descriptors  can  be  excluded  from 
the  results  of  a  search.  Any  number  of  descriptors 
can  be  used  in  a  coordination.  Moreover,  where  three 
or  four  search  levels  are  specified,  the  results  of  each 
level  of  coordination  are  recorded  and  can  be  obtained 
as  output  should  the  complete  search  yield  unsatis¬ 
factory  results. 

Machine  output  is  in  the  form  of  punched 
cards  containing  document  accession  numbers.  The  appro¬ 
priate  catalog  cards,  complete  with  the  bibliographic 
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information,  abstract,  and  indexing  terms  associated 
with  the  document  are  mailed  to  the  customer  who  may 
then  request  copies  of  the  desired  documents. 

Computer  techniques  provide  a  variety  of 
possibilities  for  compiling  aids  to  the  Indexer  and 
searcher  and  to  the  evaluator  of  the  vocabulary.  The 
frequency  of  use  of  each  descriptor  In  Indexing  and 
searching  provides  some  Indication  of  the  volume  of 
output  to  be  expected  from  a  given  search  pattern. 
Periodic  checks  of  these  figures  point  out  the  subject 
areas  of  most  interest  in  the  collection  and  may  reveal 
descriptors  that  should  be  redefined  or  abandoned. 
Tabulations  of  word  associations  in  Input,  and  output  give 
good  indications  of  promising  coordinations  for  search¬ 
ing  and  may  indicate  the  need  to  exclude  descriptors. 

Such  associations  can  also  indicate  overlapping  mean¬ 
ings  and  the  need  to  redefine  or  combine  terms. 

Technical  Abstract  Bulletin  Index 

The  development  area  of  greatest  long  term 
potential  is  ASTIA’s.  efforts  directed  toward  more 
effective  indexing  methods  and  new  techniques  for  the 
mechanized  handling  of  index  entries  for  published 
Indexes,  Because  the  printed  index  still  represents 
an  extremely  efficient  tool  for  conducting  both  current 
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awareness  and  retrospective  searches  of  the  literature, 
the  automatic  or  "slave"  print  out  constitutes  one  of 
the  most  advanced  applications  of  machine  methods  in 
the  handling  of  technical  information. 

After  several  months  of  experimentation  and 
pilot  study  designed  to  explore  methods  of  refining 
ASTIA’s  announcement  media,  ASTIA  inaugurated  a  new 
subject  index  to  TAB  (Pig.  2).  This  new  index,  gene¬ 
rated  by  a  coordinate  system  of  indexing  provides  two 
principal  advantages.  The  first  is  that  It  retains 
the  convenience  of  the  conventional  coordinate  index, 
facilitating  rapid  scanabillty  and  providing  the  multi- 
aspect  approach.  The  second  principal  advantage  Is 
that  it  minimizes  the  need  to  refer  to  the  complete 
abstract  entry  since  each  index  entry  usually  contains 
sufficient  information  to  enable  the  user  to  determine 
with  reasonable  certainty  whether  a  particular  document 
should  be  read.  Despite  the  attractive  possibility 
of  indexing  and  abstracting  by  machine  which  has  cata¬ 
lyzed  present  day  research  efforts  on  methods  of  elimi¬ 
nating  or  reducing  human  subject  analysis  of  documents, 
the  new  ASTIA  subject  index  is  a  product  of  human 
analysis  whereby  each  index  entry  is  carefully  formulated 
in  accordance  with  systematically  developed  guidelines 
for  Indexing.  Each  entry  of  the  subject  index  contains 


an  annotation  or  indicative  abstract,  A  typical  index 
entry  is  composed  of  the  following  elements;  the 
primary  descriptor,  indicated  by  an  asterisk;  the  anno¬ 
tation,  a  synthesized  statement  reflecting  the  subject 
content  of  the  document;  the  division  of  TAB  in  which  it 
appears;  and  the  ASTTA  document  number. 

With  the  appearance  of  the  new  subject  index, 
the  Technical  Abstract  Bulletin  now  provides  the 
researcher  with  an  effective  decision  making  instrument 
and  information  announcement  publication.  The  new  index 
entry  is  similar  to  the  "lengthy  hybridized  index 
entry"  developed  and  used  by  Welt  (Ref  3)  in  the  Cardio¬ 
vascular  Literature  Project  of  the  National  Research 
Council, 

Summary 

The  approach  to  multiple  access  retrieval 
at  ASTIA  has  been  that  of  formulating  a  dynamic,  but 
well-controlled  vocabulary  of  defined  descriptors  that 
are  displayed,  together  with  their  Interrelationships 
and  notes  to  indicate  their  usage,  in  the  Thesaurus  of 
ASTTA  Descriptors.  The  utility  of  this  concept  as  a 
tool  for  storing  and  retrieving  technical  report  litera¬ 
ture  and  for  formulating  accessLon  indexes  has  been 
demonstrated  by  successful  use  at  ASTTA  over  a  period 
of  many  months. 
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The  present  status  of  vocabulary  revision 
and  index  preparation  reflects  attempts  to  refine  a 
retrieval  system  while  maintaining  maximum  productivity, 
preserving  as  much  as  possible  the  validity  of  previous 
work,  and  retaining  a  high  degree  of  continuity  in  the 
system.  Such  a  situation  makes  major  policy  changes 
prohibitive,  but  leaves  opportunity  for  technical 
improvements,  many  of  which  have  been  incorporated  into 
the  revised  Thesaurus  and  the  new  TAB  index  format. 

Even  these  improvements  must  be  viewed  more  as  temporary 
expedients  than  as  long-range  solutions  to  information 
problems. 

Experience  to  date  has  clearly  demonstrated 
the  need  for  research  on  vocabulary  and  indexing  pro¬ 
blems  in  large,  multldlscipllne  libraries.  Many  con¬ 
cepts  of  information  storage  and  retrieval  that  have 
been  utilized  for  smaller,  more  specialized  collections 
cannot  readily  be  employed  at  ASTTA  or  other  large 
centers.  The  vast  amounts  of  row  data  accumulated 
by  Indexing  and  retrieval  efforts  at  such  centers  must 
be  analyzed  and  reduced  to  forms  useful  to  documental 1st s. 

Hopefully,  future  progress  in  the  vocabu¬ 
lary  and  index  development  will  be  marked  by  planned 
programs  of  cooperative  effort  among  the  major  infor¬ 
mation  centers.  This  effort  is  of  the  highest  impor- 
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tance  and  significance,  for  without  it  there  is  little 
prospect  of  bringing  about  the  needed  rapid  advances 
in  the  art  and  science  of  information  communication. 
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